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AMENDMENTS TO THE SPECIFICATION 
Please amend the specification at the paragraphs indicated below such that the 
paragraphs of the specification at those indicated locations are as follows: 



The paragraphs beginning at page 11, line 8 and carrying over to page 12, line 1 : 



Generally, the decoding process for a 91(2,4) code is known to workers skilled in the art, and 
is too involved to explain in detail herein. However, it is important to understand that, within the above- 
mentioned Hmits, any errors in the received encoded codeword can be overcome during the decoding 
process via majority voting. For example, the codewo r d a message coded in 91(2,4) can be expressed 
as a sum of codewords collection of codeword bits (c) as follows with the corresponding codeword 
formed from : 

C=MG 

where 

M=[MoMiM2] 

and where 



Decoding of the message M begins in the Reed decoding algorithm by decoding M2 and then proceeds 
to the decoding of M] and Mq as is known by a worker skilled in the art. 

For example, decoding of M2=/>Wj,. . .ntjo} leads to the following expressions: 
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C\ = 




Cz = 
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/Wq + /?24 + /W|o 


Ca = 
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/Wq "^2 /W4 + THiQ 


co^ - 


/Wo + /W2 + /W3 H" /Wg 




/Wo "I" /W2 /W3 + /W4 + /Wg + /W9 + /Wjo 


cSg = 


/Wo + /Wj 
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/W0 + /W1 +/W4 + /W7 




= /W0 + /W1 H-/W3 + /W5 




= /Wo + /Wi+ /W3 + /W4 + /W5 + /W7 + /Wio 




= /Wq ^" /Wj + /W2 /W5 




= /Wo + /Wi + /W2 + /W4 /W5 -1- 


ci4i4 


= /Wo + /Wi + m2 + /W3 + /W5 + 



^^^^^M^ ^^^^^UA ^^^^^M^ ^^^^^UA ^^^^^MA^^^^^^M^ 

ff^O > '''^ ''^^ ' 77*4 ' ' "ff^ * file^ I l/lg 

clS ^ 

77*^ ^ ''t4 "''fS 

^15 ~ /W^ + /W i + /W>, + /Wi + /Wvf + /Wc + /W^ + /W7 + /Wg 
/W o + /W 1 9 + m y X + Wl ] 7 + /W | 3 H- /W | 4 + /W fs 

The paragraph beginning at page 13» line 17 and continuing through Une 25: 

AsshowninFIG. 1 , the code r ates codeword lengths ofReed-MuUer codes are plotted against 
the cod e wo r d Icngtli code rates . The fourplotted lines represent four different mininiumdistances^ When 
the graph line showing a minimum distance of 32 (d=32) is compared with the graph line showing a 
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minimum distance of 4 (d=4), the trade-offbetween codeword length and code rate becomes apparent. 
Specifically, assuming a codeword length of 1 0,000 bits, the code rate of the code having a minimimi 
distance of 32 is approximately 0.88, while the corresponding code rate for code having a minimum 
distance of 4 is approximately 0.99. 

The paragraphs beginning at page 14, line 6 and carrying over to page 15, line 22: 

FIG. 3 illustrates acommunicationcircmt system 1 0 according to the present invention. The 
communication circtrit system 10 includes an RM-encoder 12, a partial-response channel 14, and aReed^. 
Muller enx)r correcting, partial response channel decoder 16(RM-PR 16). For simplicity, a transmission 
of a single codeword m is shown, though the same principle of operation holds for every message word 
transmitted. As shown, codeword m is input into the RM encoder 12, which generates an RM-encoded 
codewords. RM-encoded codewords is transmitted over the Partial-Response (PR) channel 14, which 
tends to introduce noise to the codewords: such that the received codeword j; is input into the RM-PR 
decoder 16, which produces an output decoded estimated codeword. 

The RM encoder 12 accepts a message word m of A:-binary digits (bits) and converts the 
message word m into a codewordjc comprised of n-bits. The codeword x is then transmitted through a 
conmiunication channel 1 4 (such as an optical fiber, a wireless communication channel, or any other type 
of communication channel) or recording channel 14 (such as magnetic hard disc drive, and the like). The 
channel 14 is equalized to a partial-response target. In other words, at decoder 1 6, the impulse response 
of the channel 14 to a pre-defined predefined transfer fimction is equalized to reduce the effect of 
intersvmbol in t erference unwanted aspects of the channel response . 

When the received codeword;; arrives at the RM-PR decoder 16, the decoder 16 must 
attempt to optimally reconstruct the transmitted message word m . Thedecoder 16 ideally minimizes the 
number of bits where 772 and m difiTer so as to minimize the number of bit errors. 
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FIG. 4 shows a modified version of the communication circmt svstem 1 0 of FIG. 3 with an 
exploded internal subsvstems view of the RM-PR decoder 16. Specifically, FIG. 4 illustrates a 
conimunicationciicmt svstem lO including an RM encoder 12, aPR channel 14, aRM-PR decode 16 and 
an interleaver 1 8 (denoted in FIG. 4 by the symbol ti^^'^^^) disposed between the RM encoder 1 2 and the 
PR channel 14. The interleaver 1 8 randomlv re-orders reorders the RM-encoded codeword jc prior to 
passingthecodewordxtothepartial-responsechannel 14. The interleaver 1 8 is added to shown here in 
the firstportionofthecommimication circuit 1 0 in order to liigliliglit the position o f show a more complete 
system with respect to the corresponding elements in the RM-PR decoder 1 6[[,]] which is presented in 
an expanded form to show the decoder 16 in greater detail. 

As shown, RM-PR decoder 1 6 has three stages A, B, and C. Stage A has a BCJR algorithm 
or SOVA algorithm based channel decoding device 20A, de-interleavers 22A (here shown as two 
interleavers de-interleavers denoted bvTi"^ to show that the corresponding two preceding outputs are being 
"de-interleaved"), and a Reed-MuUer message passing device 24A. Stages B and C have corresponding 
BCJR or SOVA algorithm based chaimel decoding devices 20B and 20C, corresponding de-interleavers 
22B and 22C, and corresponding Reed-Muller message passing devices 24B and 24C. Between stages 
A and B is an assembler 26 A and an interleaver 28 A, and between stages B and C is a corresponding 
assembler 26B and an interleaver 28B . Assemblers 26 A and 26B and interleavers 28 A and 28B perform 
a transitional function that converts the soft-decision data received from the correspondingprecedingReed- 
MuUer message passing device into the proper form forthenext stageof the decoder 16, andarc suchan 
assembler not necessary for the output of the final stage C of the decoder 16. 

The paragraphs beginning at page 16, line 21 and carrying over to page 20, line 26:: 

Generally, the code bit decisions are represented in FIG. 4 as a vector jc of length «, while the 
corresponding code bit reliabilities // (i) are represented as vectors of the same length n . These two vectors 
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are inputs to the Reed-MuUer Message Passing Algorithm block 24. For the detected vector and the 
corresponding reliability vector, the RM-MPA block 24 produces a decoded message bit m and the 
corresponding reliability vector //(/w). 

Though the decoding process could tli c o r ctically stop at this point, but for nearer to optimum 
performance, one or more additional stages of processing must occur are chosen to be performed as 
described above. The decoded message bit m and the associated reliabihty vector contain the 
decoded message bits an d informa t i o n thecoirespondinig bit reliabilities, respectively, and not codeword 
reliabilities. The message bits and hifomiation the corresponding bit reliabihties must be converted bade 
to code wo r ds and code word codeword reUabilities to be used with incoming information at the next 
processing stage . Assembler 26A r esto r es converts the hrformation message bit reliabilities fi(fh) into to 
improved code word codeword reliabilitv vectors which are then passed through an interleaver 28A (ifi'^^ 
to form X(x) that is provided to the next either BC JR or SOVA algorithm based channel decoding device 
20B. The process is repeated n times (in this case, three times), and after /i-stages, the last decoded 
message bite becomes become the output of RM-PR decoder 24C. 

As shown, the either BCJR or SOVA algorithm based channel decoding devices 20A, 20B, 
and 20C are identical. The BCJR or SOVA algorithm based channel decoding device 20A has no initial 
reliabihty vector A(x) associated with the received from the channel information codewo r d codeword j/, 
as indicated above, and so the second input of the BCJR or SOVA device 20A is a rehability vector A^jc ) 
of value zero, providing no indication of reliability. Subsequent BCJR or SOVA devices 20B and 20C 
have improved reliability vectors }J(x) at each subsequent stage, such that the final stage of processing has 
an idealized a significantlv improved rehabihty vector X(x) with which to process the code bits of the 
received cod e wo r d codeword y. Thus, the accuracy of the RM-PR decoder 1 6 improves with each 
iteration. 

Generally, the RM-MPA block 24 uses an RM code (r,m) that has the following parameters: 
length «=2'", dimension[[,]] 
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k = 



rate R -(n-k)/n, and minimum distance 2"'^, where the parameters r> 0 and m<l can be chosen arbitrarily. 
The notation 



J. 



is the combinatorial combination or "m-choose-j" function (the number of ways of selecting/ different 
objects from a set of m different objects). The RM generator matrix can be genarally written as. 



G = 



wherein the sub-ma t rix submatrix Gj , 0£J£r, is of size |^ . j x « . 

For the decoding of the RM codes, there exists an algorithm called the Reed algorithm as 
indicated above, which is a maximum likelihood decoding algorithm when only code bit hard decisions are 
available. In the present invention, the code bit reliabilities are utilized in making bit decisions instead of the 
just making code bit hard decisions. 

Generally, in the Reed algorithm, the decoding is performed in r steps. In step 7, the message 
wordjc^'' of length (y), corresponding to Gj (with indexes,) message word bits x,^^ having index s such 

that 
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f(7) + IS tc?)) 




is detected. For each of these bits, a set of 2"^^ linear equations can be written, involving all n bits of the 
received code word j;. The positions of the code bits involved in the equations for calculating the s-th 
message bit, x/^, are given b v the array corresponding one of arravs that are based on the check sum 
equation and bit solution orthogonal to each bit xfK 

In each array Pg, each column shows the locations of the code bits to be added together to give 
an estimation of the message bit x/^. This addition is modulo-2 addition. In the hard-coding version, the 
message bit is determined by a majority vote among all 2"*'^ estimations, (as described above), and the 
received code vector is updated according to the relation y [[=]]r. y + x®Gj, and then passed to the next 
decoding step (step jH- 1 ). 

In the present invention, instead ofbit values, the method uses the log-bit lik e lihoods liklihood 
ratios (LLR)[[.]] to indicate the bit reliabilities as 



where b^p^jj^ is the channel input and wherej^ is the chaimel output. The log-bit likelihood of the s-th 
message bit from the l-th equation on the j-th step is calculated as follows, assuming all code bits are 
independent[[:]]. as 
where 






(1) 
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where fi{x^j^*^) is the LLR of the expression for the 5-th message bit from the /-th equation in the 



Mh leveL and where 
and 













tanh 


[ 2 J 





(2) 



Wliere fi{x^j •/ > ^ ^ isHhe LLR of the exp re ssion fo r tlie j-tli message bi t fro m the /-th equation in tlie 



y- t h level." The LLR can be expressed as fe ll o ws: 
and 



' tanh 



\ 2 J 



' m(xY ) 

[ 2 J 



(3) 
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The product and summation operations in equations (2) and (3) above are performed on the bit likelihoods 
of the code bits whose locations in the received codeword are determined by the /-th column of the matrix 
Py. For the reduced complexity, (1), (2), and (3) may be approximated as 







min ( 













(4) 



The product and minimization operations in equation (4) are performed on the same bit hkelihoods as in 
equations ([[ 1 ]]2) and ([[2]]3). Next, the updated LLR of the^-the message bit in the [[i]]/-th level is 
calculated by combining the likelihoods obtained from all T^^ equations. In other words 



(5) 



In the hard decoding version (Reed algorithm), a message bit is determined by a maj ority vote, and the 
received code vector is updated using the expression [[(2)]] v '-v+x^^Gj given above, and then passed to 
the next decoding step. In the soft decoding version, prior to advancing to the next row of the decoder 1 6, 



First Named Inventor: BaneVasic 



Application No.: 10/634,723 



-li- 



the updated message bit likelihoods must be converted to the code bit likelihoods. This conversion is 
performed based on the submatrix Gj. 

FIG. 5 illustrates an eleven laver illust r a t ion representation of fee a "Reed gr^h" designed to place 
the mathematical formulae of the instant invention into a graphical perspective thou|gh lust shown for the 
code bits and messages bits formulae with a similar graph being used for the reliabilities formulae with 
corresponding indices . In this example, layer 1 represents a sixteen bit codeword received from the 
channel 14. In r e ality alternative situations , the codeword could be much larger than 16 bits. 

In essence layer 1 represents the coded bits received from the channel 1 6. These The equations 
given above for message bit m ^ ^. are chosen as an example, and are performed determined at layer 2 in 
FIG. 5 for reduced complexity. 



The paragraphs beginning at page 21, line 4 and carrying over to page 22, line 16: 

The positions of ones in the i-th column of (below) indicate what message bits on the 



j'th level are used to calculate tiie i-th code bit in accordance with the codeword generation matrix 
equation . For example, the nonzero elements in the 1 5-th column of G2 below are 1 , 2, and 3 . This means 
that on the second level, the message bits [[m6]]m6 (=1+5), [[m7]]m7 (=2+5) and [[m8]]m8 (=3+5) are 
used to calculate the 1 5-th code bit. On the second level of encoding in this example, only the message 
bits from the location 6 to 1 1 are used again in accord with the codeword generator matrix equation . In 
a similar fashion we can find which message bits are used to compute i-th bit on the j-th level. 

Suppose that the nonzero positions of the l-th column of Gj are given by the set {// . . . I J where 




and 




Then the conversion form from message bit LLR to codcbit code bit LLR (^-* A,) can be done as follows. 
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is provided as 

A(Jc,)=-5,-logj-taiih(|^ 



where 



[[mm 



and 



^ ^ ' mm 

The equations (6), (7), and (8) may also be approximated as follows. 











. J 
. J 





£9) 



This processing is performed layer 4 in the Reed graph of FIG. 5. 

The updated LLR's for all of the c o debits code bits, which are to be used in the next decoding 
step, are foxmd by applying equations ( 1 ),.(2), and (3), or (4) above to the output of equation (8) and 
equations (6) or (9) as the output of the previous decoding level (/-I), whicff is the same as the input to the 
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current decoding level (/). The final function of tlic processing for each of the first two stages of RM-PR 
decoder 1 6 is provided bv the assembler corresponding one of assemblers 26A[[,]] and 26B for each 
stage respectively. This assembler fimction is performed by again applying equations (6), (7) and (8) ot 
(9) to the LLR sequence of reliabilities of decoded message bits //(m), and this time the entire generator 
matrix G is used. The above equations ( 1 -[[8]]9) and subsequent updates codcbit to the code bit log 
likelihood reliabihties can be viewed as providing a message passing algorithm on a sp e cial type of graph 
called a the [["]]Reed graph[["]] indicated above . 

Then the process is repeated using the soft-decoded reliability vector derived fi*om equation 
(H) equations 6 or 9 above beginning with layer 6 in the Reed graph of Figure 5, which uses the original 
16 bits and the reliability vector. 



The paragraphs beginning at page 22, line 22 and carrying over to page 25, line 6: 



To illustrate the idea, we use the following example. Considerthe(r,m)=(2,4)RMcode. The 
corresponding generator sub-matrices are given repeated below [[.]] fi-om above as 

1111111111111111, 
'o 00000001111111 r 

0000111100001111 

001100110011001 r 

0 10101010101010 1_ 

0 00000000000111 1" 

00000000001 10011 
0000001 100000011 

oooooooooioioior 

0000010100000101 
0001000100010001 
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F ro m t lie The four equations (fr o m above), and the a rr ays o f o itii o g o nal pari t y check posi t ions for the 
message bit mn> given above are repeated here : 

'"lO = Co+Cj+Cj+Cj (lO) 

w,o = C4+C5+C6+C7 (11) 
'"lo = Cz+C9+Cio+Cu (12) 

m,o = C,2+C,3+C,4+C,5 (13) 



It is possible t o build an A corresponding array [[or]] of the orthogonal parity checks for the message^bit 
/Wio [[as]] is shown below[[.]] fP<=P |n): N o t e tlia t the first column ofP- t e is a set of indices from the first 
expression (10) above, and th e otli e r columns represent sets of indices from expressions 1 1-13. 

'0 4 8 12' 

1 5 9 13 

2 6 10 14 

3 7 11 15 



Note that the first column of P i n is a set of indices from the first expression (10^ above, and the other 





'0 4 8 12' 






1 5 9 13 






2 6 10 14 

3 7 11 15_ 
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Similarly, as indicated above, for the other message bits (w,) the corresponding ones of arravs involving 
the related checksum equations and bit solutions orthogonal thereto are 

0 18 9' 

2 3 10 11 

4 5 12 13 

6 7 14 15 





"0 
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8 


12" 
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5' 
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7 
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13 
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10 


12 


14 
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11 


15 




10 


11 


14 


15 




9 


11 


13 


15 



Jo 2 4 6 8 10 12 14" 
'~[l 3 5 7 9 11 13 15 

[0 1 4 5 8 9 12 13" 
^ [2 3 6 7 10 11 14 15 

_ro 1 2 3 8 9 10 11" 
'"[4 5 6 7 2 3 4 5_ 

_rO 1 2 3 4 5 6 7" 
'"[s 9 10 11 12 13 14 15_ 

Po=[0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] 

The Reed gr^h ofFigure 5. as indicated above, is based on the above parity check arrays is illus tr ated 
inFIG. 5 and illustrates the determination of selected ones ofthemessaee bits . The bipartite graph in the 
top portion of the figure corresponds to the orthogonal parity checks (squares) involving the second-level 



n = 



0 2 8 10 

1 3 9 11 

4 6 12 14 

5 7 13 15 



First Named Inventor: BaneVasic 



-16- 



ApplicationNo.: 10/634,723 



message bits and code bits Q=2). The connections involving the fourparity checks in the top portion are 
defined bvthecon-espondingchecksum equation andbitsolutionformessagebitm i n as reflected in the 

array [[PIO]] £10. All other connections for the second level message bits m5 Jii 6 m9 m<. ny mn can 

be found in the corresponding arrays rf,P6,».,r9 P <;,P^ P o. 

In the first step of decoding, the code bit LLR^s (layer 1 ) are passed through the check nodes 
(layer 2) to the message variables (layer 3), using equations (1), (2), and (3) or equation (4) , and the 
equation (5\ fi-om above. Aftercomputing all themessagebit likelihoods on the second level, submatrix 
G2 is used to update the code bit likelihoods using equations (5), (6), and (7) (6). (7), and (8) or equation 
[[(8)]] £9} above. The first iteration step is finished when all message bits and all message bit Ukelihoods 
are obtained and all code bit likelihoods are updated. Then, decoding proceeds to the next iteration. 



